When it Sounds like a Duck and it Looks like a Dog... Auditory icons vs. Earcons in Multimedia Environments

Myra P. Bussemakers, Ab de Haan Nijmegen Institute for Cognition and Information University of Nijmegen Montessorilaan 3, 6525 HR Nijmegen, The Netherlands +31 24 3612648 [email protected] ABSTRACT In this research a categorization paradigm is used to study the multimodal integration processes that take place when working with an interface. Redundant auditory icons are used with visual information to investigate their influence on the categorization. Results are related to earlier experiments with redundant earcons and show that reaction times are faster in conditions with auditory icons than conditions with no sound, and conditions with earcons are slower than conditions with no sound. Having sound does not always lead to faster responses. It seems that the type of sound and its congruency with visual information can have an effect.